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We generalize the usual exponential Boltzmann factor to any reasonable and potentially ob- 
servable distribution function, B(E). By denning generalized logarithms A as inverses of these 
distribution functions, we are led to a generalization of the classical Boltzmann- Gibbs entropy, 

Sbg — — / de uj(e) B(e) log B(e) to the expression S = — J de cu(e) dx A(x), which contains 

the classical entropy as a special case. We demonstrate that this entropy has two important features: 
First, it describes the correct thermodynamic relations of the system, and second, the observed dis- 
tributions are straight forward solutions to the Jaynes maximum entropy principle with the ordinary 
(not escort!) constraints. Tsallis entropy is recovered as a further special case. 
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INTRODUCTION 

It has been realized, that many statistical systems in 
nature can not be satisfactorially described by naive or 
straight forward application of Boltzmann-Gibbs statis- 
tical mechanics. In contrast to ergodic, separable, locally 
and weakly interacting systems, these systems are com- 
plex systems whose characteristic distributions often are 
of power-law type. Due to the existence of strong corre- 
lations between its elements complex systems often vio- 
late crgodicity and are prepared in states at the edge of 
chaos, i.e. they exhibit weak sensitivity to initial condi- 
tions. Further, complex systems are mostly not separable 
in the sense, that probabilities for finding a system in a 
given state factorize into single particle probabilities and 
as a consequence, renders these systems not treatable 
with Boltzmann single particle entropies However, it 
is evident that Gibbs entropies can in principle take into 
account any correlations in a given system, as the full 
Hamiltonian H , including potential terms, enters. Since 
in the following we will be only concerned about mea- 
surable quantities in statistical systems we will take the 
Gibbs entropy as a starting ground 

S G = - J dVB (-ff(r)) log (B (H(T))) , (1) 

where T are the phase space variables, and B is the Boltz- 
mann factor, which usually reads, B(H) ~ exp(— (3H), 
for the canonical distribution. It is interesting to note 
that the exponential form of the Boltzmann factor is not 
a priori dictated by classical statistical mechanics, but 
that much of classical statistical mechanics is built upon 
this special form of the Boltzmann factor, as argued e.g. 
in0. 

Classical statistical mechanics was designed for sys- 
tems with short- (or zero-) range interactions, such as 
gas-dynamics. The exponential was found to be the nat- 
ural choice in countless systems. However, for extending 



the concept of statistical mechanics to complex systems, 
which are characterized by fundamentally different dis- 
tribution functions, it seems natural to allow generaliza- 
tions of the Boltzmann factor. What is the Boltzmann 
factor? What are the minimum requirements and restric- 
tions to call some function a Boltzmann factor? 

The normalized Boltzmann factor is a probability to 
encounter a particular state in the bath system, repre- 
senting the hidden physical influences the observable en- 
semble of properties are subject to and thus closely re- 
lates to experiment. In the canonical ensemble the den- 
sity of states with energy E\ are given by 



piEx) = ui(E!)u2(E - E!)Z~ 



(2) 



where u\ is the subjective microcanonical density, i.e. the 
multiplicity of states in the ensemble of observable prop- 
erties, and 0J2 is the bath density. E is the energy of the 
total system, which is usually unknown, and Z is the par- 
tition function. Usually, the normalized U)%(E — E\)Z~ X 
is identified with the Boltzmann factor. However, in this 
form it explicitly depends on the total system energy E. 
This total energy should be factored out into a multi- 
plicative factor since measured quantities should not de- 
pend on E. This factor will be canceled by Z, which is 
of course E dependent. If the Boltzmann factor is taken 
as an exponential, this separation is trivial. Another ap- 
proach is to ask which classes of Boltzmann factors allow 
for such a factorization. The answer was given in U 
showing by a mathematical argument, that the most gen- 
eral Boltzmann factors which allow for an E separation 
are of so-called ^-exponential type. 

In the following, we start by exploring a most gen- 
eral form of the Boltzmann factor, compatible with the 
requirements of normalizability, monotonicity and the 
possibility of E separation. We do not fix the specific 
form of this factor which (in principle) can be deter- 
mined from measurements. We ask whether one can 
construct a theoretical framework where data, i.e. the 
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measured distribution serves as a starting point to con- 
struct an entropy which is consistent with both, the cor- 
rect thermodynamic relations and the Jaynes maximum 
entropy principle According to this modification of 
logics it is sensible in a first step to modify or deform 
the log in Eq. to a generalized logarithm A. The 
concept of deforming logarithms and thus modifying the 
form of entropy in order to accommodate a large body 
of experimental data from complex systems is not new 
H UB II II H El El An axiomatic definition of gen- 
eralized logarithmic and exponential functions A and £ 
has been given in ^3 where also the concept of dual 
logarithms of the form A*(x) = — A(l/x) has first been 
introduced. An algebraization of the deformed concept, 
i.e. x®y = £(A(x)+A(y)), and x®y = A{£(x)£(y)), has 
been given in |2| , where this structure has been exploited 
in the context of special relativistic mechanics. In |l3| a 
constrained variational principle has then been utilized 
with respect to trace-form entropies deriving a family of 
three-parameter deformed logarithms log( K)T .^\, being the 
most general of its kind so far, containing - to our best 
knowledge - all possible logarithms that are compatible 
with the standard variational principle SG — 0, with the 
usual functional 

G = S G [B] - pfdeu(e)B(e)(e-U) ( , 

- 1 {Jdeio{e)B{e)-l) , W 

with the generalized Gibbs entropy 

Sg[B] = - J deu{e)B (e) A (B (e)) , (4) 

where U is the measured average energy, w(e) is the mul- 
tiplicity, (3 is the usual inverse temperature, and 7 is the 
Lagrange parameter for normalizability. 

The novel logics of this paper is that we start from 
a measured distribution, the Boltzmann factor, which is 
not necessarily of standard exponential form. We want 
to keep the intuition of the origin of the Boltzmann fac- 
tor as the adequately normalized contributions of the 
bath, i.e. we require p(E) — u>(E)B(E), where w is the 
multiplicity of the energy state in the observable system 
and represents our knowledge about the experimental 
device we observe in order to retrieve data. In princi- 
ple, u> can be known which makes the Boltzmann fac- 
tor B(E) = p(E)/ui(E) factor indirectly measurable. To 
keep close formal contact with usual statistical physics, 
we represent the measured Boltzmann factor by replac- 
ing the usual exponential function by some function £ , 
i.e. 

exp(-P(E-U)-j)^£(-p(E-U)-j) , (5) 

where 7 is the normalization constant. We then con- 
struct an entropy such that two requirements are strictly 
fulfilled: First, the entropy leads to the correct thermody- 
namics of the system, and second, the Jaynes variational 
principle holds. 



THE GENERALIZED BOLTZMANN FACTOR 

Let us start by listing three "axioms" containing the 
intuitively clear minimum requirements for a Boltzmann 
factor B, 

1. B is monotonous and positive. 

2. B can be normalized, i.e. J deu>i(e) B(e) = 1. 

3. B must not explicitly depend on the total system 
energy. It must be possible that the E term in the 
argument of loi(E — E\) can be factored out, i.e., 
lo 2 {E - Ei) = F{E - E*) B{E 1 - E*), where the 
normalized version of B we shall call a Boltzmann 
factor. F is some function, and E* some reference 
energy, e.g. the equilibrium energy. In U and 01 
an explicit program was shown how this separation 
is uniquely obtained. 

We thus write a Boltzmann factor which fulfills all re- 
quirements 

B(H) = £(-(3(H-U)-j) , (6) 

where 7 is the normalization constant (partition func- 
tion), U and (3 being the measured average energy and 
inverse temperature, respectively. Monotonicity and pos- 
itivity are assumed to be properties of the generalized ex- 
ponential functions £ , which then implies the existence of 
inverse functions, the associated generalized logarithms 
A = From a generalized logarithm A and its dual 

(A*(x) = — A(x^ 1 )) one assumes the usual properties, 

A : R+ -> R 

A(1) = , A'(l) = l , A'>0 (7) 
A" < (convexity) , 

implying analogous properties for the generalized expo- 
nential function. 

Now, with any representative of the above allowed gen- 
eralized Boltzmann factor B and its associated logarithm 
A let us in a first step generalize Gibbs entropy Eq. 0J, 
(same as Eq. 

S G = - J dTB (-ff(r)) A (B (H(T))) , (8) 

and compute the Gibbs entropy as follows 

S G = - J dT B (H) A (B (H)) 

= -JdefdT5(e-H)B(e)A{B{e)) 
= Jde to H (e) £ (-/3(e - U) - 7) (J3(e -U)+j), 

(9) 

where u>h(E) = J dTS(E — H) is the microcanonic mul- 
tiplicity factor for the energy E which represents the ob- 
servable system. As a shorthand notation we will write 
Eq. © as in Eq. Q, S G = J de to(e) B(e) A(B(e)), with 
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B(E) = £{-P(E - U) - 7). With the definition of the 
expectation value 

(/) = [de /(e) u> H (e) £ (-/3(e - U) - 7) , (10) 



it becomes obvious that the normalization constant 7 has 
to be chosen such that 



de u H {e)8{-p{e-U)-*i) = 1 



(11) 



Using this and specifying (e) = U, we get Sq = 7- We 
drop the subscript H in the following. Looking at Sg 
for (3 — 0, implies that B(E) = Z~ x = const, for Z = 
J de 10(e), and therefore S G = - J de u{e)Z~ 1 A(Z- 1 ) = 
— A(Z^ 1 ). Thus one identifies 



G 



J = -A(Z- 1 )=A*(Z) 



(12) 



Note, that to get a finite Z it is necessary to under- 
stand the integral J decu(e), in the limits Ex = 0, and 
E2 = £max, where E maK is the largest energy of the ob- 
servable system. Such regularizations are of course im- 
plicitly present under all experimental circumstances. If 
we wish this relation to hold for all f3 it is interesting 
to observe that the partition function Z also has to be 
defined in a deformed way, i.e. using the definition of 
the deformed product x®y = £ (A(x) + A(y)) , analogous 
to ■ The renormalization condition can then be recast 
into the form 

B{H)=(^\®£{-f3{H{T)-U)) , (13) 

which becomes the defining equation for the generalized 
partition function Z. In this sense the generalization 
of Boltzmann factors naturally involves dual logarithms, 
whose occurence has been noted recently in the context 
of generalized entropies [6J, |8|, |9j, UlM ■ This is of course 
just of relevance for non self-dual logs, examples of which 
include the g-logarithm (\og*(p) — log 2 „ 9 (p)) and the 
Abe-log 0- 



THE VARIATIONAL PRINCIPLE 

Using the standard variational principle Eq. on the 
basis of the generalized entropy given in Eq. © (with 
the usual constraints!), the only possible choice for A is 
the ordinary log. To see this, variation of Eq. ® yields 



dB 



BA(B) = -7 - f3(E - U) 



(14) 



By substituting B = £ (— /?(e — U) — 7)), it is clear that 
the only solution to this is A(B) — \og(B), and £ can 
thus only be the ordinary exponential Boltzmann factor. 
This is unsatisfactory. 



The problem arises because for any generalized A other 
than the ordinary log there exists a non-trivial extra 
term, BA'(B), in Eq. (|L4|) . In order to cancel this term 
we suggest to further generalize the generalized logarithm 
A(B) to a functional in the following way, 



A(B) -» A[B] ee A(B) - rj[B] 



(15) 



where we use [B] to indicate functional dependence on 
B. By substituting A by A in Eq. (@J, we obtain the 
entropy 



S[B] = S G [B] + t)[B] 



(16) 



where we have used that 77 is a constant with respect to 
e-integration and the normalization condition l|llfl ■ Now 
the idea is that after variation with respect to B, the 
additional term jgT)[B], can be used to cancel the term 
~uj{E)B(E)-^ s A(B(E)). The corresponding condition, 
5 r)[B] = u(E)B{E)-^A(B{E)), implies the form of 77 



SB 



V[B] 



de to(e) 



B(e) 



dx A\x)x + c 



(17) 



(18) 



(19) 



Let us substitute this into Eq. (|16fl to get 

S[B] = r][B] - Jde uj(e) B(e) A(B(e)) 
= -Jdecu(e)J^ ie) dxA(x)+c , 

with c an integration constant which is only different 
from c, iff lim^^o xA(x) ^ 0. Note immediately that 
the classical entropy is a special case of Eq. <(T%)l . 
i.e. taking A(x) — log(cc), yields the Boltzmann en- 
tropy modulo an irrelevant additive constant, S[B] — 
-Jde tu{e) B(e) \og(B(e)) +5+ I. 

It can now easily be checked that this entropy Eq. (|18fl , 
in combination with the standard maximum entropy 
principle under the usual constraints, yields the measured 
distributions B. Let us define 

G = S[B] - /3jdeuj(e) B(e) (e - U) 
- jijdecoie) B(e)-l) , 

and vary with respect to B, to get 

JbG = oj(e)B{E)A'{B{E)) - ^(E)B(E)A(B(E)) 
- w{E)i - w{E)p{E - U) = , 

(20) 

or equivalently, A(B(E)) = -7 - (3(E - U). Using that 
£ is the functional inverse of A, the correct generalized 
Boltzmann factor, B(E) = £(—(3(E — U) — 7), is recov- 
ered. 



THERMODYNAMICS 

To show that the proposed entropy of Eq. 1|18|) is fully 
consistent with the expected thermodynamic relations, 
differentiate Eq. (|18|l with respect to U and get 

d 



dU 



S[B] = p 



(21) 
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Note, that the thermodynamics here is simply dU = 
TdS, since no further assumptions have been made on 
other measurements neither in terms of thermodynamic 
potentials (e.g. —PdV or —fidN) nor other (experimen- 
tally controllable) macro-state variables. 

Finally, if one wants to write the proposed entropy Eq. 
(|18|l in a form that is suggested by the classical Gibbs 
form one can, by defining L, of course write 

S[B] = - j de W (c) C €) dx A(x) m) 
ee -Jdeu(e)B(e)L(B(e)) , 1 > 

which implies the relation 

1 f a 

L{a) = - dx A(x) . (23) 
a Jo 

It is maybe interesting to note that L is nothing but the 
mean value of the A. Of course, in general L is not an 
inverse of B. 

EXAMPLES 

Example: Classical Boltzmann distributions. If the ex- 
perimentally measured tail of a distribution is of Boltz- 
mann type, B(E) ~ exp(-(3E), then A(B) ~ log(B), 
and by using Eq. (EHJ), L(B) = ^(Slog(B) - B), which 
when put into Eq. (|22|l . yields the Boltzmann entropy, 
S[B] = -Jde tu(e) B(e) log(B(e)) + 1. 

Example: Asymptotic power-law distributions. If an 

experimental distribution of a ^-exponential is observed 

as frequently done in complex systems, i.e. B(E) — 
i 

[1 — (1 — q)E] 1 ~ q . Thus the generalized logarithm is the 
so-called g-log, A(B) = \og q (B) = ^J*" 1 . Inserting as 
before gives the Tsallis entropy 0,0 times a factor, 

S[B] = - J- J de u(e) B(e) \og q (B(e)) + ^— , 

(24) 

where we require q < 2. The factor can in principle be 
absorbed into a transformation of (3 and 7. At this point 
it is also obvious that in the case of power law distri- 
butions the question of normalizability can become an 
issue. Notice, however, that since not B but p — ujB has 
to be normalizable an implicit regularization is provided 
by the maximal energy -E max that the observable system, 
represented by u>, can assume. 

CONCLUSION 

We started by relaxing the restriction that the Boltz- 
mann factor has to be of exponential form, to allow other 



types of observed distributions, B(E), as well. By doing 
so we introduce corresponding generalized logarithms, A 
(as inverses of B), and suggest to construct the entropy 
of systems leading to non-exponential distributions, as 
S = — j de uj(e) J Q B ^ dx A(x). This is nothing but re- 
placing the plogp term in the usual entropy by the in- 
tegral, J A(p). Obviously classical Boltzmann-Gibbs en- 
tropy is obtained for the special case of A(x) = log(x). 
We demonstrate that this entropy leads to the correct 
thermodynamics of the system, and the observed distri- 
bution functions are derived naturally from the maxi- 
mum entropy principle with the usual constraints. Fur- 
ther we show that this entropy can be written as a stan- 
dard generalized Gibbs entropy (J BAB) with adding a 
constant which is functionally dependent on the mea- 
sured distribution 15]. This term somehow captures 
numbers of states in the system, which may depend on 
parameters like temperature. The functional form of 
measured distributions, which is a kind of knowledge 
about the system, is thus naturally fed into the defini- 
tion of the entropy of the system. 

A further detail in the proposed entropy definition is 
that it does not contain any additional parameters, once 
the distribution is known. Once given the data, there is 
no more freedom of choice of the generalized logarithms, 
nor of the functional form of the constant. 

We thank J. Lutsko for a number of important sugges- 
tions. 
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